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Objectives: The aim of this study was to estimate the relationship between the financial impact of a new drug and the recommendation for reimbursement by the Australian Pharmaceutical Benefits 
Advisory Committee (PBAC). 

Methods: Data in the PBAC summary database were abstracted for decisions made between July 2005 and November 2009. Financial impact — ^fhe upper bound of the values presented in the PBAC 
summary database — was categorized as <A$0, >A$0 up to A$10 million, A$l 0 million up to A$30 million, and >A$30 million per year. Descriptive, logistic, survival, and recursive partitioning 
decision analyses were used to estimate the relationship between the financial impact of a new drug indication and the recommendation for reimbursement. Multivariable analyses controlled for other 
clinical and economic variables, including cost per quality-adjusted life-year gained. 

Results: Financial impact was a significant predictor of the recommendation for reimbursement. In the logistic analysis, the odds ratios of reimbursement for drug submissions with financial impacts 
>A$10 million to >A$30 million or >A$0 to <A$10 million compared with <A$0 were 0.12 (95 percent confidence interval [CI]: 0.03-0.51) and 0.16 (95 percent CI: 0.04-0.60), 
respectively. In the recursive partition decision analysis, the first split of the data was for submissions with a positive financial impact compared with those with a zero or negative financial impact. 
Conclusions: In Australia, financial impact on the drug budget is an important detemiinant of whether a new drug is recommended for reimbursement when cost-effectiveness estimates and other 
clinical and economic variables are controlled. 
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Over the past few decades, health technology assessment (HTA) 
agencies in many countries (1-5) have been established to in- 
form decisions about public reimbursement of new drugs after 
an assessment of the drugs' economic profiles as well as ef- 
ficacy and safety. These agencies review manufacturers' sub- 
missions of selected new drugs to the HTA agency that include 
estimates of the cost-eflfectiveness of the new drug and the ex- 
pected financial impact of the drug on short- and long-term 
healthcare budgets when the new drug is reimbursed at the 
requested price. Their submission guidelines include detailed 
guidance on the estimation of the cost-effectiveness of the new 
drug. The guidance for financial impact analysis provided by 
the HTA agencies is generally less detailed than guidance for 
cost-eflfectiveness analysis. Limited guidance on methods for fi- 
nancial impact analysis is given in the Institute for Quality and 
Efficiency in Health Care (IQWiG) and WellPoint guidelines 
(2;5). However, PBAC provides very detailed guidelines about 
how the financial impact should be estimated (4). 

Within the Australian system, new drugs submitted for ap- 
proval for reimbursement on the national Pharmaceutical Bene- 
fits Scheme (PBS) are assessed for relative safety, effectiveness, 
cost-effectiveness, and financial impact by PBAC. The PBAC 
operates two subcommittees that review and comment on the 
economic evaluation, if included; and the proposed use and 
financial impact. The outputs of an external evaluation by an 
academic center and the two PBAC subcommittees are collated 
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for the appraisal discussion at the full PBAC, and a recommen- 
dation is made to the Minister of Health to list, with or without 
restrictions; not to list; or defer. If a rejection is recommended, 
the manufacturer may resubmit the application at the next avail- 
able submission date. The final decision on whether to list the 
drug includes consideration of additional factors such as extent 
of uimiet need and ethical implications. 

A series of recent articles has focused on the possibility that 
financial (or budget impact) analysis has, at least implicitly, an 
impact on the probability that a new drug will be reimbursed 
(6-8) in addition to the well-proven impact on the likelihood 
of reimbursement of therapeutic value, cost-effectiveness, and 
burden of disease. These articles have pointed out that financial 
impact analysis is needed to fully understand the opportunity 
costs associated with the new intervention and its affordability 
(7;9-l 1). However, despite the requirement to include financial 
impact estimates in submissions to HTA agencies, Niezen and 
colleagues (8) concluded that "policy makers do not easily ad- 
mit that they consider budget impact and are even reluctant to 
explicitly use budget impact as a formal criterion." 

Three recent quantitative studies (12-14) have estimated 
the impact of different explanatory variables on PBAC recom- 
mendations about reimbursement for new drugs. The primary 
focus of these studies was to estimate the impact of estimates 
of drug cost-effectiveness on the probability of being approved. 
All of these studies found that the probability of a drug being 
recommended for reimbursement in Australia by PBAC was 
correlated with its estimated cost-eflfectiveness ratio: the higher 
the ratio, the less likely approval. These studies used diflferent 
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analj^ical methods, including descriptive analysis (13), probit 
multivariable analysis (14), and logistic regression analysis (12). 
All of these studies also looked at the effects of other economic 
and clinical variables on the reimbursement recommendation, 
including a measure of aimual financial impact on the Aus- 
tralian drug budget. In all these studies, the financial impact on 
the Australian drug budget also was found to be a significant 
predictor of the reimbursement recommendation. 

In this study, we extended these published analyses of PBAC 
data to include more recent data and to focus more specifically 
on the financial impact to the Australian drug budget. To provide 
a more complete understanding of the relationship between the 
financial impact on the Australian drug budget and the prob- 
ability of PBAC recommendation for reimbursement, we sub- 
divided financial impact into several categories and performed 
descriptive analysis as well as logistic regression, survival analy- 
sis using logistic regression, and recursive partitioning decision 
analysis. Survival analysis was performed to estimate the impact 
of multiple submissions on the reimbursement recommenda- 
tion. Recursive partitioning decision analysis was performed to 
provide an indication of the relative importance of the different 
explanatory variables for the reimbursement decisions. All the 
multivariable analyses controlled for the cost-effectiveness ratio 
values and other variables that have previously been shovra to 
be associated with the probability of a PBAC recortmiendation 
for reimbursement in Australia (12-14). 

METHODS 

The data file of recommendations by PBAC was created by 
abstracting data fi-om the PBAC Web site (http://vvww.health. 
gov.au/intemet/main/publishing.nsf/Content/pubHc-summary- 
documents-by-product). Data were taken fi-om recommenda- 
tions made fi-om July 2005 through November 2009. In the 
data file, a unique identification number was created for each 
product and its indication. If a product had more than one 
submission for the same indication, more than one record was 
created under the same unique identification number. However, 
if a product had multiple submissions that included a different 
indication, a new unique identification number was created 
for that product and indication. The data file included PBAC's 
reconmiendation (to reconmiend a listing with or without 
restrictions, not to recommend a listing, or to defer), the 
incremental cost-effectiveness ratio (cost per quality-adjusted 
life-year [QALY]), and the highest value of the financial impact 
presented in the summary document for each product. In 
addition, other variables were abstracted that have been shown 
to be associated with PBAC's reimbursement recommendations 
in previous studies (12;13) (Supplementary Table 1, which can 
be viewed online at www.journals.cambridge.org/thc2013079). 

The PBAC recommendation was the outcome variable in 
this study. The four categories of outcomes abstracted were com- 
bined to create a binary variable with categories recortmiended 



(yes, restricted yes), and not recommended (no, deferred). The 
predictors of the PBAC recommendation that were tested in the 
analyses were either abstracted or derived variables that were 
classified as either economic variables or clinical variables as 
seen in previous studies (12-14). 

Economic variables included the following: (i) Popula- 
tion size, created from reported patient population size treated 
per year: low (< 10,000), medium (10,000-50,000), and high 
(>50,000). (ii) Estimated financial impact per aimum, using the 
upper bound value presented and estimated for the impact on 
only the drug budget: <A$0, >A$0 to <A$10 milHon, >A$10 
million to <A$30 million, and >A$30 million. A categorical 
variable was used for the analysis because the PBAC summaries 
presented financial impact as an upper bound or range rather 
than a continuous variable for most of the submissions, (iii) Cost 
per QALY, using the upper bound base case analyses: >A$0 to 
<A$45,000, >A$45,000 to <A$75,000, and >A$75,000 as 
used in the Chim and colleagues study (12) of the impact of 
cost-effectiveness on reimbursement decisions. A fourth cate- 
gory, no cost-effectiveness analysis presented, was assigned to 
those submissions that used a cost-minimization approach for 
the economic evaluation. 

Clinical variables included the following: (i) Active com- 
parator (yes or no) that indicated whether an active comparator 
was used as the comparison group in at least one of the pivotal 
studies; (ii) Manufacturer claim for the clinical benefits of the 
new product: noninferior or equivalent or superior; (iii) Com- 
parative clinical evidence available from randomized clinical 
trials only (RCT) or from RCT data plus a meta-analysis or in- 
direct comparison analysis (RCT plus meta-analysis or indirect 
comparison analysis); (iv) Disease category (oncology or other), 
as a proxy measure of likelihood of reduced life expectancy and 
the "dread" factor associated with the disease (12); and (v) Sur- 
rogate end point (yes OR no), derived from a review of the end 
points in the submission. 

The unit of analysis for all analyses was the unique drug 
and indication submission after July 2005. Only the first ob- 
served submissions of the unique drug and indication com- 
bination within our database were included in the univariate 
and initial multivariable logistic analyses because subsequent 
resubmissions were correlated with the first observed submis- 
sion. All analyses were performed in SAS 9.3 or JMP 8. A test 
result was declared statistically significant if p value was < .05 
and marginally statistically significant if p value was > .05 but 
< .1. 

First, a univariate analysis was performed to explore the as- 
sociation between the PBAC recommendation and the variables 
described previously. The association was tested by Pearson's 
chi-squared test. Next, a multivariable logistic regression was 
performed to evaluate the relationship between the probability 
of a positive recommendation and the categorical financial im- 
pact, while adjusting for other factors. The variables included 
in the logistic model were those that had an association with the 
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recommendation with a p value <. 30 in the univariate analysis 
(15). 

A discrete time-to-event analysis was performed, including 
all extracted data: both the first observed submission data and all 
resubmission data to determine the relationship between multi- 
ple submissions and PBAC recommendations while accounting 
for the correlations between repeated submissions and to deter- 
mine the impact of the omission of the resubmissions on our 
estimates for financial impact. We performed the analysis using 
the logistic model as described in Allison (16). Total submis- 
sion count was determined by counting the number of times the 
same drug plus indication was submitted. Only nine records had 
a total count of four or more, and these records were omitted 
from the analysis. The variable time since previous submission 
was included because the resubmissions happened at irregular 
intervals. A submission or resubmission for a drug plus indi- 
cation that happened once or more than once but that was not 
recommended for reimbursement was considered to be a right- 
censored observation. Also, submissions could be left censored 
if data for the first observed submission indicated that previous 
submissions had occurred before July 2005. 

Finally, a decision tree analysis was performed using the re- 
cursive partitioning algorithm in JMP analysis software (SAS, 
Gary, NC). Recursive partitioning is a nonparametric classifica- 
tion technique that splits into subsets, called nodes, observations 
with similar response values for predictor variables (17). In each 
node, the predictor variable with the strongest association to the 
outcome variable is chosen for splitting the node. For a cate- 
gorical outcome, the recursive partitioning algorithm in JMP 
analysis software uses logio (p value), also called logworth, 
where the p value is an adjusted p value given by a likelihood 
ratio test. To avoid overfitting, only partitions that had a log- 
worth value >1.12, which corresponded to logio (0.05), were 
performed. Because this is a nonparametric method, it has an 
advantage over logistic regression by not assuming any func- 
tional form for the association between predictors and outcome. 
Furthermore, recursive partitioning has the advantage of detect- 
ing possible complex interactions between predictors that may 
not have been detected by the logistic regression, and because 
it is easy to visualize and interpret, it is suitable for a decision- 
making process (18). Moreover, the relative importance of the 
predictors can be inferred by the order in which they partition 
the data (i.e., the earlier the predictor is used by the partition 
algorithm, the more important it is). 

The logistic regression and decision tree analyses were also 
performed using only those submissions with a reported cost 
per QALY to assess the importance of financial impact in this 
subset of the total submissions. 

RESULTS 

A total of 260 submissions, representing 214 unique drug plus 
indication combinations and 46 resubmissions during the data 



abstraction time period, were extracted Irom the PBAC Web 
site. Most, or 170 of the 214 (79.5 percent) unique drug plus 
indication combinations, were not submitted before July 2005; 
27 (12.6 percent) were submitted once before July 2005; and 17 
(7.9 percent) were submitted multiple times before July 2005. Of 
the 260 submissions, 106 (40.8 percent) were recommended for 
reimbursement, 47 (18.1 percent) were partially recommended 
for reimbursement (i.e., recommended with restrictions), 100 
(38.4 percent) were not recommended for reimbursement, and 
7 (2.7 percent) were deferred. Therefore, the binary variable 
PBAC recommendation for reimbursement had 153 submis- 
sions (58.9 percent) that were recommended and 107 submis- 
sions (41.1 percent) that were not recommended. 

Table 1 presents the univariate association between recom- 
mendation category and potential predictors. Five variables — 
financial impact, cost per QALY, manufacturer's claim, active 
comparator, and disease category — had a statistically signif- 
icant association with the PBAC recommendation. With the 
exception of the financial impact category >A$30 million, the 
percentage of submissions that were recommended decreased 
as the financial impact and the cost per QALY increased. In ad- 
dition, 74.3 percent of the submissions that did not report a cost 
per QALY were recommended as compared with 40.0 percent 
for those submissions with a reported cost per QALY. The per- 
centage of recommendations was higher for entries that claimed 
noninferiority or equivalence, that had used an active control as 
the comparator in at least one pivotal clinical trial, and that 
were not in the oncology category. The other included variables 
(population size, comparative clinical evidence, and surrogate 
end points) did not have a statistically significant association 
with the PBAC recommendation. Based on the univariate anal- 
yses, six possible predictors of PBAC recommendations with a 
univariate p value <.30 were included in the logistic models. 

Figure 1 and Supplementary Table 2, which can be viewed 
online at www.journals.cambridge.org/thc2013079, present the 
results of the multivariable logistic analyses. Only the effect 
of financial impact (p = .0242), cost per QALY (p = .0235), 
and active comparator (p — .0365) were statistically significant. 
After adjusting for the other factors in the model, the only sta- 
tistically significant odds ratios for financial impact were for 
comparing either category >A$10 million to <A$30 million 
(0.12; 95 percent confidence interval [CI]: 0.03-0.51) or >A$0 
to <A$10 milHon (0.16; 95 percent CI: 0.04-0.60) with the cat- 
egory <A$0. The odds ratio for the financial impact category 
>A$30 million compared with the category <A$0 was not sig- 
nificant (0.25; 95 percent CI: 0.05-1.34). For cost per QALY, 
the only statistically significant odds ratios were for compar- 
ing the category >A$75,000 with either the category >A$0 to 
A$45,000 (0.11; 95 percent CI: 0.02-0.55) or to the category 
none (0.06; 95 percent CI: 0.01-0.40). The odds of recommend- 
ing a drug submission that used an active comparator were 2.49 
(95 percent CI: 1.06-5.85) times the odds of recommending a 
drug submission that used placebo as the primary comparator. 
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No. in each Percentage in each variable 
variable category recommended for p Value for difference 
Variable category reimbursement by PBAC between categories'" 



Financial impact (million A$) 



>30 


22 


45.5% 


<.0001 


>10to<30 


42 


35.7% 




>0to<10 


101 


54.5% 




<o 


39 


92.3% 




Cost per quality-adjusted life-year (thousand A$) 








>75 


19 


15.8% 


<.0001 


>45to<75 


27 


33.3% 




>0to<45 


59 


50.9% 




None 


109 


74.3% 




Population size 








High 


40 


47.5% 


.3671 


Medium 


52 


59.6% 




Low/ 


122 


59.8% 




Manufacturer claim 








Superior or advantages 


108 


43.5% 


<.0001 


Noninferior or equivalent 


106 


71.7% 




Comparative clinical evidence 








Randomized controlled trial 


00 
77 


CI CO/ 


0709 
.Lll L 


RCT + Meta-analysis or indirect comparison analysis 


115 


60.9% 




Active comparator 








No 


52 


32.7% 


<.0001 


Yes 


162 


65.4% 




Disease category 








Oncology 


37 


40.5% 


.0219 


Other 


177 


61.0% 




Surrogate end point 








Yes 


150 


58.0% 


.5846 


No 


54 


53.7% 





° Percentages were calculated out of the available data for the respective variable category. 
P value was calculated using Pearson's chi-square test for difference between the variable categories. 
PBAC, Pharmaceutical Benefits Advisory Committee. 



Figure 1 presents a plot of selected odds ratios obtained from 
the tirst logistic model. Financial impact was not statistically 
significant {p — .1801) when the same model was run using 
only submissions that reported a cost per QALY (n = 103). 
Cost per QALY was the only statistically signiticant factor {p — 
.0158) in this model. 

Figure 2 and Supplementary Table 2 present the results of 
the analysis of discrete-time survival data, using multivariable 
logistic analysis. The statistically significant effects were total 
submission count {p — .0029), financial impact (p = .002 1), cost 
per QALY (p — .0135), and an active comparator (p — .0229). 



The odds ratio estimates for financial impact, cost per QALY, 
and an active comparator were very similar to the corresponding 
odds ratios obtained in the first model. After adjusting for other 
factors in the model, the odds of recommending a drug that 
was submitted a third or second time were 9.62 (95 percent CI: 
2.47-37.42) or 3.66 (95 percent CI: 1.35-9.96) times the odds 
of recommending a drug submitted the first time, respectively. 
The odds of recommendation were 0.83 lower for a 1-trimester 
increase in time since the previous submission. Figure 2 presents 
the odds ratio plots for the second logistic model. When the 
same model was run only using submissions (n — 126) with a 
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Financial impact 
>A$30mil. vs. SA$0 

Financial impact 
2 A$10 mil. to £ A$30 mil. vs. £ A$0 

Financial Impact: 
>A$0to</\$10mil. vs.^0 

Cost per QALY: 
>A$75,000vs. None 

Cost per QALY: 
> A$45,000 to < A$75,000 vs. None 

Cost per QALY: 
> A$0 to £ A$45,000 vs. None 

Active: 
yes vs. no 

Disease category: 
oncology vs. other 

IVianufacturer daim: superior or 
advantages vs. non-inferior or equivalent 

Comparative clinical evidence: RCT vs. RCT + 
meta-analysis or indirect comparison analysis 



0.001 



r — ^ 



0.01 



0.1 

Odds ratio 



10 



Rgure 1 . Multivariable logistic regression results (n = 204): odds ratios with 95% CI plots. CI, confidence Interval; QALY, qualit^diusted lifeyear; RCT, randomized controlled trial. 



reported cost per QALY, financial impact was still statistically 

significant {p = .0223). 

Figure 3 presents the recursive partition decision tree. In ad- 
dition to the variables used in the logistic analyses, population 
size and surrogate end point were also included. Categorical 
financial impact was the most important factor to make the first 
partition (logworth = 7.18) by grouping the three financial im- 
pact categories, >A$0 to <A$10 million, >A$10 million to 
<A$30 million, and >A$30 million, into a single category and 
comparing it with <A$0. Cost per QALY, active comparator, 
and disease category were the next predictors selected for re- 
cursive partitioning. For cost per QALY, the categories none 
and >A$0 to A$45,000 were combined by the model program 
and compared with >A$45,000to <A$75,000 and >A$75,000. 
The results of the recursive partitioning model indicated that the 
chance of being recommended for reimbursement for drug sub- 
missions with a financial impact <A$0 was 91.4 percent, and 
the chance for drug submissions with a financial impact >A$0 
and a cost per QALY either not estimated or A$0 to < A$45,000 
was 57.5 percent as compared with 24.4 percent for submissions 
with a financial impact >A$0 and cost per QALY >A$45,000. 
Lower chances for reimbursement recommendation were esti- 
mated for drug submissions with a financial impact > A$0, a cost 



per QALY either not calculated or >A$0 to <A$45,000, and 

without an active comparator (29.6 percent). When a new tree 
was constructed considering only submissions with a reported 
cost per QALY, the cost per QALY was the only important factor 
in the partitioning analysis. 

DISCUSSION 

The results of the analyses presented in this study indicate that 
the estimated financial impact of a drug on the Australian drug 
budget is a predictor of the PBAC reimbursement recommenda- 
tion, even when controlling for the cost-eflfectiveness ratio and 
other confounding variables. In the descriptive analysis, there 
was a gradient in probability of reimbursement, with the highest 
probability for drugs that were estimated to be cost-saving and 
the lowest probability for drugs that were estimated to increase 
annual costs between A$10 million and A$30 million. How- 
ever, probability of recommendation was higher for those sub- 
missions with a financial impact of >A$30 million compared 
with those with a financial impact of >A$10to <A$30 million. 
The logistic analyses demonstrated that this pattern was similar 
even when controlling for the cost-eflfectiveness ratio and other 
confounding variables and the number of submissions and even 
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Total submissions count: 
3rd time vs. 1st time 

Total submissions count: 
2nd time vs. 1st time 



Rnandal impact: 
>A$30mil. vs.^A$0 



Financial impact: 
> A$10 mil. to <A$30 mil. vs. < A$0 



Financial impact: 
>A$0to<A$10mil.vs.£A$0 



Cost per QALY: 
>A$75,000vs. None 



Cost per QALY: 
> A$45,000 to s A$75,000 vs. None 



Cost per QALY: 
>A$0to£A$45.000vs.None 

Active: 
yesvs.no 

Disease category: 
oncology vs. other 

Manufacturer claim: superior or 
advantages vs. non-inferior or equivalent 

Comparative clinical evidence: RCT vs. RCT + 
meta-analysis or indirect comparison analysis 



0.01 



-0- 



0.1 



1 



10 



100 



Odds ratio 

Rgure 2. Multivariable logistic regression results for discrete time-ta«vent data (n = 238): odds ratios witti 95% CI plots. CI, confidence interval; QALY, quclity-adiusted life-year; RCT, randomized controlled trial. 



when only including those submissions that presented a cost 
per QALY estimate. A review of the submissions with an esti- 
mated financial impact >A$30 million (22 submissions) found 
that products in this category that were recommended for reim- 
bursement either had cost per QALY estimates in the lower end 
of the A$0 to A$45,000 range, or very favorable clinical ben- 
efits, or indications where there were no alternative treatments 
that might explain this seemingly anomalous result. 

The impact of multiple submissions on the probability 
of recommendation for reimbursement was significant with 
an odds ratio of 9.62 for a third and 3.66 for a second ob- 
served submission compared with the first observed submis- 
sion. Supplementary Table 3, which can be viewed online at 
vvww.joumals.cambridge.org/thc2013079, presents a summary 
of the changes in the categorical values among the 29 multiple 
submissions. A review of these changes indicated that, although 
reductions in price were likely key factors in obtaining a posi- 
tive reimbursement recommendation in many cases, changes in 



the clinical data submitted were also influential in obtaining a 
positive recommendation. 

Finally, the recursive partitioning decision analysis sup- 
ported the importance of a positive financial impact for the 
reimbursement decision with the full database because the vari- 
able with the greatest discriminative power for reimbursement 
recommendations was shown to be a positive financial impact 
of any magnitude, followed by the cost per QALY. However, 
the results for the subset of submissions that report a cost per 
QALY, all of which had a positive financial impact, indicated 
that the cost per QALY variable had the greatest discriminatory 
power 

A threshold value of A$ 1 0 million was used for the financial 
impact analysis because fiiU approval by the cabinet of the 
federal government was needed for drugs when their annual 
financial impact was expected to exceed A$10 million in any 
12-month period within the first 4 fiiU years of product listing. 
Having mandated that a multiyear financial impact analysis be 
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All Rows 
1^ I 116 

Level Probability Logworth 



□ No 

[ Yes 



0.43 

0 . b /' 



7.18 



I 



Financial impact 
(<A$0) 



I 



Level 

□ No 



Probability 

0.08 



Financial impact 




(> A$0 to < A$10 mil, > A$1 0 mil to < A$30 mil, > A$30 mil) 


k ^ II 




Level Probability Logworth 


□ No 0.52 


3.94 


□ V.;;s 0.48 







Cost per QALY 




(None, > A$0 to < A$45,000) 




51 1 69 




Level 


Probability Logworth 


■ No 


0.42 


3.06 


■ Yes 


0.58 





Active (Yes) 


Active (No) 




■ 1 


Level Probability 
■ No 0.34 
□ Yes 0.66 


Level Probability 

□ No 0.70 

□ Yes 0.30 



Cost per QALY 




(> A$45,000 to < A$75,000, > 


A$75,000) 


llB^ II 1 




Level Probability 


Logworth 


■ No 0.76 


1.47 


■Yes 0.24 





I 



Disease category 
(Other) 



20 



10 



Level 

■ No 

■ Yes 



Probability 
0.67 
0.33 



1 



Disease category 
(Oncology) 



14 



Level 

■ No 

■ Yes 



Probability 
0.93 
0.07 



Rgure 3. Recuisive partition decision tree in — 204). 



included in submissions has allowed the PBS to put in place 
price-volume contracts for those drugs that exceed the A$10 
million per year limit (19), although the specific agreements are 
confidential. 

The results of our analyses are supported by and extend 
those from three previous analyses of PBAC data (12-14). All 
three studies included financial impact on the healthcare sec- 
tor as an explanatory variable. In the supplemental appendix 
of Clement et al. (13), in a descriptive analysis of submissions 
not needing a cost-per-QALY estimate, the probability of re- 
imbursement in Australia was much higher (81 percent) than 
for those needing a cost-per-QALY estimate (44 percent) (13). 
In the Harris et al. (14) study, for a sample of the decisions 
that also included an estimate of the cost-per-QALY gained, 
Harris and colleagues (14) estimated that for each increase of 
A$5 million in financial impact above the mean value, the prob- 
ability of a PBAC recommendation for reimbursement would 
decrease by 0.03. However, by excluding any submissions that 
estimated financial cost-savings and many that estimated a bud- 



get impact <A$ 1 0 million, they may have underestimated the 
importance of the financial impact for reimbursement decisions, 
especially for drugs with multiple submissions. Finally, Chim 
and colleagues (12) compared the impact on reimbursement of 
two financial impact categories: <A$10 milHon and >A$10 
million. In a logistic analysis, they estimated a statistically sig- 
nificant odds ratio of reimbursement of 0.46 for submissions 
with a financial impact of >A$IO million compared with those 
with a financial impact of < A$ 1 0 million. 

The strengths of our analysis included the use of multi- 
ple analytic techniques that all provided similar results. The 
use of the survival analysis allowed us to include data from 
multiple submissions as well as right- and left-censored sub- 
missions, appropriately accounting for the correlation among 
repeat submissions of the same drug/indication pair. The use of 
the recursive partition decision analysis estimation technique is 
important because the results provided a simple stepped process 
for predicting whether a submission will be recommended for 
reimbursement in Australia. 
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The analysis also has some limitations. The major limita- 
tion is that, in many cases, the financial impact on the drug 
budget or the cost per QALY was provided in the public sum- 
mary document only as an inequality or range. Thus, it was not 
possible to enter financial impact into the model as a continuous 
variable. Instead, we created four financial impact categories. 
Also, the sample size was relatively small (N = 260), limiting 
our ability to include a high number of explanatory variables or 
more than four categories of financial impact. There was also the 
possibility of multicoUinearity among the independent variables 
used in the analysis. To test for this, we estimated "tolerance" 
scores for each independent variable and found that all variable 
scores were above 0.40, values not considered to be of concern 
for multicoUinearity (16). Supplementary Table S4, which can 
be viewed online at www.joumals.cambridge.org/thc2013079, 
presents the regression results. The choice of oncology as a 
proxy for disease severity was also a source of uncertainty be- 
cause other diseases may also be associated with very limited 
life expectancy and "dread." 

The implications of the findings in this study are that, in 
Australia, the financial impact on the drug budget is an impor- 
tant determinant of whether a new drug is recommended for 
reimbursement with the strongest positive impact for products 
that have a zero or negative financial impact. Our findings are 
consistent with the conclusions of the recent published analyses 
on the possibility that financial impact plays a role in the HTA 
agency reimbursement recommendations, although not specifi- 
cally listed as a criterion (6-8). In addition, the explicit instruc- 
tions provided in the PBAC submission guidelines for perform- 
ing financial impact analysis indicate the potential importance 
of these results for the PBAC review. Although financial im- 
pact is a specific part of the decision making for reimbursement 
in Australia, this is not necessarily the case in other countries. 
Whether financial impact influences reimbursement decisions 
in these countries is an empirical question that can be resolved 
only by performing similar analyses in these jurisdictions. 

SUPPLEMENTARY MATERIAL 

Supplementary Table 1 : 
www.joumals.cambridge.org/thc20 1 3079 
Supplementary Table 2: 
www.joumals.cambridge.org/thc20I3079 
Supplementary Table 3 : 
www.joumals.cambridge.org/thc20 1 3079 
Supplementary Table 4: 
www.joumals.cambridge.org/thc20 1 3079 
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